Skip to content

Fix load of z-image-turbo#9264

Open
thelittlefireman wants to merge 3 commits intomudler:masterfrom
thelittlefireman:patch-1
Open

Fix load of z-image-turbo#9264
thelittlefireman wants to merge 3 commits intomudler:masterfrom
thelittlefireman:patch-1

Conversation

@thelittlefireman
Copy link
Copy Markdown

Description

This PR fixes error on load z-image-turbo

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Signed-off-by: thelittlefireman <5165783+thelittlefireman@users.noreply.github.com>
@mudler mudler requested a review from richiejp April 7, 2026 13:02
Copy link
Copy Markdown
Collaborator

@richiejp richiejp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this! May have to drop the flash attention settings or else remove it when Intel is present.

- llm_path:Qwen3-4B.Q4_K_M.gguf
- vae_path:ae.safetensors
- offload_params_to_cpu:true
- diffusion_flash_attn:true
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately this is broken on Intel SYCL. I'm not sure how we want to handle this @mudler ?

- diffusion_flash_attn:true
parameters:
model: z_image_turbo-Q4_K.gguf
model: z_image_turbo-Q4_0.gguf
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks!

Removed 'diffusion_flash_attn' parameter from configuration.

Signed-off-by: thelittlefireman <5165783+thelittlefireman@users.noreply.github.com>
@thelittlefireman thelittlefireman changed the title Fix load of z-image and improve speed Fix load of z-image-turbo Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants